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BACKGROUND OF THE INVENTION 



1. 



Field of the Invention 



[0002] The present invention relates to systems and methods for displaying images on a display 
device. More specifically, the present information relates to systems and methods for 
displaying text characters on a display device having separately controllable pixel sub- 
components, with selected edges of the characters being positioned at high contrast pixel sub- 
component boundaries. 



2. Background of the Invention 

[0003] A key aspect of many technologies, especially computers, is the requirement of visual 
interaction with an end user. In fact, the data and information displayed by many applications 
are especially designed to have a visually pleasing and aesthetic appearance. Word processors, 
for example, typically attempt to emulate an actual piece of paper by causing the screen to 
display a graphical a piece of paper. As the word processor creates a document, the text and 
images are placed on the graphic piece of paper as they will appear when physically rendered. 
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The visual interaction of the end user with the display device is therefore an integral part of 
many technologies. 

[0004] An important aspect of the visual interaction with an end user is the ability to display 
color. A typical display device has a screen that has a large number of pixels, and each pixel 
usually has red, green, and blue sub-pixels. Because the pixels are relatively small, the color 
discerned by the human eye is a blend of the red, green, and blue lights of each pixel. By 
varying the intensity of the red, green, and blue lights, a display device is potentially capable of 
displaying millions of different colors. 

[0005] One common display device used to display color is a cathode ray tube (CRT) display 
device. The pixels of a CRT display are arranged in a particular geometry, with each pixel 
consisting of three phosphors that emit light when excited by a beam of electrons. For CRT 
display devices, the luminous intensity values assigned to the phosphors are calculated together 
and the three phosphors in a pixel are controlled together to generate at the pixel a color 
perceived by the user as having a selected hue, intensity and saturation. 

[0006] Another common display device, which is typically used for portable computers, is a 
liquid crystal display (LCD). LCD displays are preferable to CRT displays in many instances 
primarily because LCD displays are usually smaller, weigh less, and consume less power than 
comparably sized CRT displays. In computers that rely on batteries for their power, this is a 
significant advantage. The technology of LCD displays enables them to rival CRT displays in 
terms of sharpness and resolution. 

[0007] Several differences, however, exist between CRT and LCD displays. Pixels of LCD 
display devices, unlike those of CRT display devices, consist of a plurality of pixel sub- 
components (usually three) that are separately addressable and inherently separately 
controllable. In addition, the pixels in an LCD display are usually arranged to form horizontal 
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or vertical stripes of same-colored pixel sub-components, whereas the geometry of a the 
phosphors in a pixel of a CRT display is frequently triangular. In most LCD display devices 
used with portable computers, the pixels sub-components are arranged vertically, which results 
in red, green, and blue vertical stripes of same-colored pixel sub-components. Other LCD 
display devices have pixel sub-components arranged to form red, green and blue horizontal 
stripes of same-colored pixel sub-components. Other geometries may be used, but vertical and 
horizontal arrangements are the most common. 

[0008] The ability of an LCD display or other display to provide high resolution is dependent 
in part on the size and quantity of the pixels in the LCD display, and in many situations, the 
resolution of LCD displays is not sufficient to enable text characters to be smoothly drawn or 
rendered on the LCD display. The limited resolution of the LCD display may have a 
significant visual impact on the user as the text or image data is rendered on an LCD or other 
display. 

[0009] Text characters or fonts, in particular, present unique problems. Technology permits a 
font to be stored on a computer with high resolution and when a high resolution character is 
rendered on a low resolution or coarse display device, the character is fitted to the pixel grid of 
the display device. This results in a loss of information relating to the characters and frequently 
compromises the shape of the characters, which is contrary to the intent of the typographer. 
[0010] More specifically, when a character is rendered to a low resolution display device or 
pixel grid, certain parts of the character as it is stored electronically may not fall exactly on the 
pixel boundaries. As a result, the shape of the character is forcibly changed to conform with 
pixel boundaries in the pixel grid. The ultimate effect on the character is that the character may 
be displaced in a certain direction or the stems, serifs, and other features of the character may 
be somewhat thicker or thinner than originally designed by the typographer. 
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[0011] Conventional text rendering processes that result in text characters being displayed on 
display devices were originally designed to conform to the CRT model of pixels having three 
phosphors that are controlled together to display a single color and to represent a single portion 
of the image. With the advent of large numbers of portable personal computers, existing text 
rendering processes designed for CRT display devices were simply directly applied to LCD 
display devices. Such conventional text rendering process, when applied to LCD display 
devices, use each pixel to represent a single portion of the image, and do not take advantage of 
the separately addressable nature of the pixel sub-components. 

[0012] In view of the foregoing, there is a need in the art for techniques for rendering text on 
LCD display devices that can improve the resolution of the text. It would be desirable to 
provide systems and methods that could enhance the readability of text and reduce the character 
distortion that has previously resulted from edges of characters being repositioned to 
boundaries of full pixels of LCD display devices. 
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BRIEF SUMMARY OF THE INVENTION 
[0013] The present invention relates to systems and methods of rendering text and other images 
on LCD display devices or other display devices having pixels with separately controllable 
pixel sub-components. According to the invention, individual pixel sub-components represent 
different portions of a text character or another image, rather than the entire pixel representing a 
single portion. This is accomplished by mapping spatially different sets of one or more 
samples of the image data to individual pixel sub-components. Because the pixel sub- 
components are separately addressable and controllable, the LCD display device operated 
according to the invention renders images with improved resolution compared to the resolution 
generated by conventional rendering processes. 

[0014] While the principles of the invention can be used to render any image, the invention is 
described herein primarily in the context of text characters. As part of the invention, character 
data is hinted, or fitted to a grid, such that selected edges of the character fall on high contrast 
boundaries between pixel sub-components, thereby further improving the appearance and 
readability of the text. Thus, not only are portions of the character displayed with sub-pixel 
resolution, but selected edges of the character are also positioned to reduce the color fringing 
errors or effects that would otherwise be experienced. 

[0015] The hinting process of the invention involves analyzing the topology of the outline of 
the character at runtime to identify edges of the character that are to be repositioned to high 
contract boundaries between pixel sub-components. While the invention extends to a direct 
and full analysis of the topology of the character, it is often more computationally efficient to 
analyze portions of the character definition in a font file to identify control points on the 
character that are to be fitted to the high contrast boundaries and distances between the control 



points. 
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[0016] Additional advantages of the invention will be set forth in the description which 
follows, and in part will be obvious from the description, or may be learned by the practice of 
the invention. The advantages of the invention may be realized and obtained by means of the 
instruments and combinations particularly pointed out in the appended claims. These and other 
features of the present invention will become more fully apparent from the following 
description and appended claims, or may be learned by the practice of the invention as set forth 
hereinafter. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
[0017] In order that the manner in which the above-recited and other advantages of the 
invention are obtained, a more particular description of the invention briefly described above 
will be rendered by reference to specific embodiments thereof which are illustrated in the 
appended drawings. Understanding that these drawings depict only typical embodiments of the 
invention and are not therefore to be considered to be limiting of its scope, the invention will be 
described and explained with additional specificity and detail through the use of the 
accompanying drawings in which: 

[0018] Figure 1 illustrates an exemplary system that provides a suitable operating environment 
for the present invention; 

[0019] Figures 2a and 2b depict a portion of an LCD display and show the separately 
controllable pixel sub-components of the pixels of the LCD display; 

[0020] Figure 3 is a block diagram illustrating the process of rendering or rasterizing image 
data on a display device; 

[0021] Figure 4a is an illustration of a character before it is positioned on pixel boundaries; 
[0022] Figure 4b is an illustration of the character after it has been positioned on pixel 
boundaries; 

[0023] Figure 4c is an illustration of the character after is has been phase adjusted and the 
stems have been aligned on high contrast pixel sub-component boundaries; 
[0024] Figure 5a is an illustration of the distances and dimensions associated with a character; 
[0025] Figure 5b is an illustration of a directed acyclic graph used to represent the distances 
associated with a character; 

[0026] Figure 6 is an illustration of the outline and control points that define a character; 
[0027] Figure 7 is a block diagram of the hinting process; and 
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[0028] Figure 8 is a more detailed block diagram illustrating the method of phase adjusting a 
character. 
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DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION 
[0029] One of the major problems associated with displaying information such as text on the 
screen of a display device is that the display device has a coarse pixel grid having a resolution 
that is much lower than the resolution of the information to be displayed. As a result of this 
discrepancy, the rendering or rasterization process usually distorts and compromises the 
information being displayed. In the case of text, the character shapes are altered such that they 
fit the pixel grid of the display device. The visual appearance and legibility of text or other 
information on a screen is addressed in part by the process of hinting or instructing, which 
addresses the legibility issues of color, readability, spacing, weight, alignment, symmetry, and 
actual bitmap shapes of each character by aligning the typographical features of the characters 
in a font along pixel or pixel sub-component boundaries. 

[0030] In the case of black text on a white background and other combinations, color refers to 
the balance between the black and white on a screen. An even and consistent color results in 
more legible text. Color is affected by the contrast between thick and thin stem weights, the 
size of the spacing that is internal to the characters, the smoothness of a diagonal stroke and 
other factors. An even color is less distracting to a reader. Hinting improves the balance 
between white and black on the display device such that the displayed image approaches an 
even color. 

[0031] Readability refers to the identifiability of a particular character. Character sets, which 
are frequently referred to as fonts, typically contain a number of glyphs or characters which are 
represented by one or more outlines. At low resolutions and small font sizes, it is difficult to 
legibly represent a character and it is frequently necessary to alter the bitmap image that 
represents the glyph or character. Proper spacing also contributes to legibility especially at low 
resolutions. Improper spacing typically occurs because the outline of the character is typically 
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rounded up or down in order to accommodate the low resolution pixel grid of a display device. 
Text data, however, is more legible if the space between characters and between words appears 
to be constant to the reader. 

[0032] The weight of a character generally refers to the thickness of the character and the 
strokes of the character. For instance, a font that is bolded has a heavier weight than the same 
font that is not in bold type. Much of the difficulty with regard to weight occurs between 
uppercase and lowercase characters. Uneven weighting can result in uppercase characters 
drawing too much attention to themselves or to an inability to distinguish headings from text. 
[0033] Alignment refers to the tallness or pixel height of characters. Characters should be kept 
aligned especially at small sizes where a difference in the pixel height is more noticeable, 
because text that is not properly aligned appears wavy and distracts the reader. The symmetry 
of a character is usually an issue with characters having diagonal strokes although symmetry is 
an issue with characters that have other types of strokes, including rounded curves. Controlling 
the symmetry can improve the appearance of individual characters and enhance the color of the 
text. In sum, hinting a font or character enhances the legibility and appearance of a font as 
described above. 

[0034] The invention is described below by using diagrams to illustrate either the structure or 
processing of embodiments used to implement the systems and methods of the present 
invention. Using the diagrams in this manner to present the invention should not be construed 
as limiting of its scope. The present invention encompasses both methods and systems for 
automatically optimizing the placement of typographical features along high contrast 
boundaries. 



1. Exemplary Computing and Hardware Environments 
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[0035] The embodiments of the present invention may comprise a special purpose or general 
purpose computer including various computer hardware, as discussed in greater detail below. 
Embodiments within the scope of the present invention also include computer-readable media 
for carrying or having computer-executable instructions or data structures stored thereon. Such 
computer-readable media can be any available media which can be accessed by a general 
purpose or special purpose computer. By way of example, and not limitation, such computer- 
readable media can comprise RAM, ROM, EEPROM, CD-ROM or other optical disk storage, 
magnetic disk storage or other magnetic storage devices, or any other medium which can be 
used to carry or store desired program code means in the form of computer-executable 
instructions or data structures and which can be accessed by a general purpose or special 
purpose computer. When information is transferred or provided over a network or another 
communications connection (either hardwired, wireless, or a combination of hardwired or 
wireless) to a computer, the computer properly views the connection as a computer-readable 
medium. Thus, any such a connection is properly termed a computer-readable medium. 
Combinations of the above should also be included within the scope of computer-readable 
media. Computer-executable instructions comprise, for example, instructions and data which 
cause a general purpose computer, special purpose computer, or special purpose processing 
device to perform a certain function or group of functions. 

[0036] Figure 1 and the following discussion are intended to provide a brief, general 
description of a suitable computing environment in which the invention may be implemented. 
Although not required, the invention will be described in the general context of computer- 
executable instructions, such as program modules, being executed by computers in network 
environments. Generally, program modules include routines, programs, objects, components, 
data structures, etc. that perform particular tasks or implement particular abstract data types. 
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Computer-executable instructions, associated data structures, and program modules represent 
examples of the program code means for executing steps of the methods disclosed herein. The 
particular sequence of such executable instructions or associated data structures represent 
examples of corresponding acts for implementing the functions described in such steps. 
[0037] Those skilled in the art will appreciate that the invention may be practiced in network 
computing environments with many types of computer system configurations, including 
personal computers, hand-held devices, multi-processor systems, microprocessor-based or 
programmable consumer electronics, network PCs, minicomputers, mainframe computers, and 
the like. The invention may also be practiced in distributed computing environments where 
tasks are performed by local and remote processing devices that are linked (either by hardwired 
links, wireless links, or by a combination of hardwired or wireless links) through a 
communications network. In a distributed computing environment, program modules may be 
located in both local and remote memory storage devices. 

[0038] With reference to Figure 1, an exemplary system for implementing the invention 
includes a general purpose computing device in the form of a conventional computer 20, 
including a processing unit 21, a system memory 22, and a system bus 23 that couples various 
system components including the system memory 22 to the processing unit 21. The system bus 
23 may be any of several types of bus structures including a memory bus or memory controller, 
a peripheral bus, and a local bus using any of a variety of bus architectures. The system 
memory includes read only memory (ROM) 24 and random access memory (RAM) 25. A 
basic input/output system (BIOS) 26, containing the basic routines that help transfer 
information between elements within the computer 20, such as during start-up, may be stored in 
ROM 24. 
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[0039] The computer 20 may also include a magnetic hard disk drive 27 for reading from and 
writing to a magnetic hard disk 39, a magnetic disk drive 28 for reading from or writing to a 
removable magnetic disk 29, and an optical disk drive 30 for reading from or writing to 
removable optical disk 31 such as a CD-ROM, CD-R, CD-RW or other optical media. The 
magnetic hard disk drive 27, magnetic disk drive 28, and optical disk drive 30 are connected to 
the system bus 23 by a hard disk drive interface 32, a magnetic disk drive-interface 33, and an 
optical drive interface 34, respectively. The drives and their associated computer-readable 
media provide nonvolatile storage of computer-executable instructions, data structures, 
program modules and other data for the computer 20. Although the exemplary environment 
described herein employs a magnetic hard disk 39, a removable magnetic disk 29 and a 
removable optical disk 31, other types of computer readable media for storing data can be used, 
including magnetic cassettes, flash memory cards, digital video disks, Bernoulli cartridges, 
RAMs, ROMs, and the like. 

[0040] Program code means comprising one or more program modules may be stored on the 
hard disk 39, magnetic disk 29, optical disk 31, ROM 24 or RAM 25, including an operating 
system 35, one or more application programs 36, other program modules 37, and program data 
38. A user may enter commands and information into the computer 20 through keyboard 40, 
pointing device 42, or other input devices (not shown), such as a microphone, joy stick, game 
pad, satellite dish, scanner, or the like. These and other input devices are often connected to the 
processing unit 21 through a serial port interface 46 coupled to system bus 23. Alternatively, 
the input devices may be connected by other interfaces, such as a parallel port, a game port or a 
universal serial bus (USB). A monitor 47 or another display device is also connected to system 
bus 23 via an interface, such as video adapter 48. In addition to the monitor, personal 
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computers typically include other peripheral output devices (not shown), such as speakers and 
printers. 

[0041] The computer 20 may operate in a networked environment using logical connections to 
one or more remote computers, such as remote computers 49a and 49b. Remote computers 49a 
and 49b may each be another personal computer, a server, a router, a network PC, a peer device 
or other common network node, and typically includes many or all of the elements described 
above relative to the computer 20, although only memory storage devices 50a and 50b and their 
associated application programs 36a and 36b have been illustrated in Figure 1. The logical 
connections depicted in Figure 1 include a local area network (LAN) 51 and a wide area 
network (WAN) 52 that are presented here by way of example and not limitation. Such 
networking environments are commonplace in office-wide or enterprise- wide computer 
networks, intranets and the Internet. 

[0042] When used in a LAN networking environment, the computer 20 is connected to the 
local network 51 through a network interface or adapter 53. When used in a WAN networking 
environment, the computer 20 may include a modem 54, a wireless link, or other means for 
establishing communications over the wide area network 52, such as the Internet. The modem 
54, which may be internal or external, is connected to the system bus 23 via the serial port 
interface 46. In a networked environment, program modules depicted relative to the computer 
20, or portions thereof, may be stored in the remote memory storage device. It will be 
appreciated that the network connections shown are exemplary and other means of establishing 
communications over wide area network 52 may be used. 

[0043] Figures 2a and 2b illustrate physical characteristics of an exemplary LCD display 
device that can be used to display characters processed using the hinting operations of the 
invention. The portion of LCD 70 depicted in Figure 2a includes a plurality of rows R1-R12 
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and a plurality of columns C1-C16. Color LCDs utilize multiple distinctly addressable 
elements and sub-elements, herein referred to as pixels and pixel sub-components, respectively. 
Figure 2b, which illustrates in greater detail the upper left hand portion of LCD 70, 
demonstrates the relationship between the pixels and pixel sub-components. 
[0044] Each pixel includes three pixel sub-components, illustrated, respectively, as red (R) sub- 
component 72, green (G) sub-component 74 and blue (B) sub-component 76. The pixel sub- 
components are non-square and are arranged on LCD 70 to form vertical stripes of same- 
colored pixel sub-components. The RGB stripes normally run the entire width or height of the 
display in one direction. Common LCD display devices currently used with most portable 
computers are wider than they are tall, and tend to have RGB stripes running in the vertical 
direction, as illustrated by LCD 70. Examples of such devices that are wider than they are tall 
have column-to-row ratios such as 640 x 480, 800 x 600, or 1024 x 768. LCD display devices 
are also manufactured with pixel sub-components arranged in other patterns, including 
horizontal stripes of same-colored pixel sub-components, zigzag patterns or delta patterns. 
Moreover, some LCD display devices have pixels with a plurality of pixel sub-components 
other than three pixel sub-components. The present invention can be used with any such LCD 
display device or flat panel display device so long as the pixels of the display device have 
separately controllable pixel sub-components. 

[0045] A set of RGB pixel sub-components constitutes a pixel. Thus, as used herein, the term 
"pixel sub-component" refers to one of the plurality of separately controllable elements that are 
included in a pixel. Referring to Figure 2b, the set of pixel sub-components 72, 74, and 76 
forms a single pixel. In other words, the intersection of a row and column, such as the 
intersection of row R2 and column CI, represents one pixel, namely (R2, CI). Moreover, each 
pixel sub-component 72, 74 and 76 is one-third, or approximately one-third, the width of a 
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pixel while being equal, or approximately equal, in height to the height of a pixel. Thus, the 
three pixel sub-components 72, 74 and 76 combine to form a single substantially square pixel. 
This pixel/sub-component relationship can be utilized for rendering text images on a display 
device, as will be further explained below. 
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2. Hinting and Other Image Processing Operations 

[0046] Figure 3 is a block diagram illustrating the rasterization process or the process of 
rendering text on a display device. The rendering process of Figure 3 is capable of displaying 
characters on LCD display devices with sub-pixel precision. In other words, the dimensions of 
the features of the characters, particularly in the direction perpendicular to the striping of the 
display device, are not limited to being integer multiples of the corresponding dimension of the 
full pixels. Instead, each separately controllable pixel sub-component of the pixels represents a 
different portion of the displayed character. 

[0047] As part of the rendering process, embodiments of the methods of the invention include a 
step for hinting the image data such that a typographical feature (e.g., a stem) is adjusted to a 
position on a grid corresponding to a high contrast boundary between pixel sub-components. 
The grid, as is further described below, has grid locations defined by the pixels and pixel sub- 
components of the display device, hinting the image data, and the acts that correspond thereto, 
are described in greater detail below. 

[0048] The process of Figure 3 begins with text output 101, which may be provided by an 
application such as a word processor or can be an electronic data structure that represents a 
document. Character data 102 is typically located in a data store such as a font file and 
generally contains information describing a particular set of characters. 
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[0049] Character data 102 may contain, for example, the outline of each glyph in the character 
set. The outlines are mathematical descriptions of the shapes of the glyphs in the character set 
or font using lines and curves. Additionally, each outline has several control points which are 
needed to scale the glyph to the desired type size and resolution. Some of the control points are 
on-curve points and other points are off-curve points. To define a character edge, for example, 
one or more on-curve control points are chosen. Similarly, a pair of control points can delimit 
a character stem. The on-curve points are grid fitted in the hinting process and the off-curve 
points are placed using interpolation instructions. Also, the control points may be used to 
indicate certain dimensions and distances, such as stem width. In the hinting process, a touched 
point refers to a point that has been hinted or grid-fitted and an untouched point refers to a point 
that has not been hinted or grid-fitted. It is therefore possible for both touched and untouched 
points to refer to either on-curve points or off-curve points. The terms "on-curve" and "off- 
curve" refer to the geometry of the characters and the terms "touched" and "untouched" 
typically refer to the hinting or grid-fitting strategy. 

[0050] Text output 101 and character data 102 together represent image data 100, which is 
received by scaling module 104. Scaling module 104 scales image data 100 such that 
subsequent processing operations may take advantage of the higher resolution that can be 
achieved using pixel sub-components. Because a pixel grid may have, for example, either 
horizontal striping or vertical striping, the scaling is typically performed at a greater rate in the 
direction that is perpendicular to the grid striping. Examples of scaling operations that can be 
used in conjunction with the hinting operations of the invention are described in greater detail 
in U.S. Patent Application Serial No. 09/168,013, filed October 7, 1998, entitled "Methods and 
Apparatus for Resolving Edges within a Display Pixel," which is incorporated herein by 
reference. 
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[0051] After image data 100 has been scaled, it is hinted or grid fitted by hinting module 106. 
Hinting module 106 functions in part to preserve, as much as possible, the regularity of 
character locations and distances, preserve the character proportions and to control the digitized 
appearance. In many instances, however, the pixel grid of the display device has low 
resolution, in comparison to the high resolution of the character, and it is necessary to make 
certain trade-offs. For example, it is difficult to have both the right and left edges of a character 
stem in the correct place and maintain the proper stem weight or thickness. 
[0052] In general, hinting module 106 aligns the characters along pixel sub-component 
boundaries, regardless of whether the pixel sub-component boundaries are also boundaries 
between full pixels. This is performed by changing or distorting the glyph outline to ensure 
that the correct pixels and pixel sub-components are turned on or off when the glyph is 
rasterized. Once a glyph is grid-fitted, the control points, which are typically numbered, will 
not be changed, but the coordinates of those control points may have shifted. 
[0053] Scan conversion module 108 is the process of converting the scaled and hinted 
character into a bitmap image. Because the characters or text data may be hinted to pixel sub- 
component boundaries, each pixel sub-component can be separately mapped. This allows a 
character to be rendered with higher resolution. Scan conversion module 108 determines which 
pixel sub-component should be turned on and which pixel sub-components should be turned 
off. Scan conversion module 108 produces bitmap image 110 which is displayed on display 
device 112. The systems and methods of the present invention are described herein with 
reference to a display device having vertical striping, but can be applied to display devices 
having pixels arranged in other geometries, including but not limited to, horizontal striping. 
Examples of scan conversion operations that can be used with the hinting operations of the 
invention are disclosed in greater detail in U.S. Patent Application Serial No. 09/168,014, filed 
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October 7, 1998, entitled "Methods and Apparatus for Performing Image Rendering and 
Rasterization Operations," which is incorporated herein by reference. 

[0054] The scan conversion operations can result in a single sample being mapped to each of 
the pixel sub-components of a pixel Alternatively, any number of samples can be mapped to 
the pixel sub-components. In general, spatially different sets of one or more samples are 
mapped to each pixel sub-component. The process of mapping sets of samples to pixel sub- 
components can be understood as a filtering process. The filters correspond to the position and 
number of samples included in the sets of samples mapped to the individual pixel sub- 
components. Filters corresponding to different colors of pixel sub-components can have the 
same size or different sizes. The samples included in the filters can be mutually exclusive (e.g., 
each samples is passed through only one filter) or the filters can overlap (e.g., some samples are 
included in more than one filter). In general, the filters used in the scan conversion process can 
be adapted to produce desirable color effects on the displayed images. 

[0055] Figure 4a illustrates pixel grid 200 that represents the position of pixels on an LCD 
display device. Image data representing a text character 205 has been scaled by a factor of 
three in the direction perpendicular to the stripes of the display device and by a factor of one in 
the direction parallel to the stripes. The scaling is conducted so as to prepare the text character 
for the scan conversion process in which samples are mapped to individual pixel sub- 
components. Grid 200 is a computational tool used in the rendering process to adjust selected 
edges of the character to high contrast boundaries between pixel sub-components. 
[0056] Pixel grid 200 corresponds to a plurality of pixels 201 of the LCD display device (e.g., 
display device 70 of Figure 2a), with and each pixel 201 having a red pixel sub-component 202, 
a blue pixel sub-component 203, and a green pixel sub-component 204. As is often the case in 
the image rendering process, the outline of character 205 does not coincide with a pixel sub- 
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component boundary. For instance, edge 206 does not coincide with a pixel sub-component 
boundary. Because character 205 does not match up with pixels 201 and the pixel sub- 
components 202, 203, and 204, the shape and placement of character 205 may be altered or 
grid-fitted during the rasterization process. 

[0057] Figure 4b illustrates character 205 after it has been grid fitted to pixel grid 200. As 
illustrated, character 205 has been physically moved down and to the left and stems 209 have 
been slightly narrowed during the rasterization process. This rounding effect, as illustrated in 
Figure 4b, occurred at pixel boundaries. 

[0058] Figure 4c illustrates character 205 after it has been grid fitted to pixel sub component 
boundaries. Character edge 206 has been snapped to boundary 208 between a green pixel sub- 
component and a blue pixel sub-component. Boundary 208 is preferred to boundary 207 
between red and green pixel sub-components because boundary 208 has a higher contrast, 
although the invention can also extend to snapping character edges to boundaries between 
adjacent red and green pixel sub-components. The ability of the present invention to grid fit 
character 205 to pixel sub-component boundaries provides extra precision in the rendering 
process. In addition to fitting characters to pixel sub-component boundaries, the selection of 
high contrast boundaries have been found to improve the readability of the displayed 
characters. It has also been found that aligning the left edge of stems (e.g., edge 206) is often 
more important in yielding highly readable characters than aligning other portions of the 
character with high contrast boundaries. 

[0059] The invention extends to any process whereby selected edges of characters are 
repositioned to high contrast pixel sub-component boundaries during the hinting operation. A 
direct and full analysis of the topology of a character at runtime is one way of identifying the 
features of the character that should be repositioned according to the invention. While this type 
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of full topological analysis can be used, it is often computationally inefficient or impractical to 
do so. Accordingly, any available technique for making only a partial topological analysis at 
runtime can be used, thereby reducing computational time and resources. 
[0060] Many character sets or fonts have font definitions or other information that lend 
themselves to being used to make an partial analysis of the topology of the characters during 
runtime, sufficiently so that selected edges or portions of the characters can be repositioned to 
high contrast pixel sub-component boundaries during the hinting operation. Such font 
information that can be used for this purpose includes any information that defines the position 
and spacing of certain typographical features, such as character edges and stem widths. 
[0061] While the invention can be used with substantially any type of font, a specific example 
of performing a partial topological analysis of a character outline during runtime will be 
presented in the context of TrueType fonts. TrueType font files include control value tables 
(CVTs). The CVT is a table that is derived from information encoded in files, including True 
Type font files, that lists the color of distances as well as dimensions for various letter features, 
such as stem widths. The CVT allows a font designer to refer to particular distances by name 
rather than as an abstract distance. The width of a character stem, for example, may be referred 
to as the Vertical Stem Thickness. As used herein, the control value table is intended to be 
representative of information associated with characters that describes certain distances and 
dimensions of the character. Frequently, the distances and dimensions are described in terms of 
key control points on the outline of the character. 

[0062] One feature of CVTs that can conveniently used to describe the topology of text 
characters is the description of certain distances in a character by color.. A horizontal distance 
of a character, as described in a CVT, can be a black distance, a white distance, or a grey 
distance. Black distances describe distances that are interior to a letterform (e.g., the width of a 
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stem), white distances describe distances that correspond to regions generally outside the body 
of the character (e.g., left and right-side bearings, spaces between stems, the open counter of 
"O", etc.), and grey distances describe distances that include a white and a black distance. 
[0063] Figure 5a illustrates these distances with reference to character 205. Character 205 has 
two stems 209. The first stem begins at point A and ends at point B and the second stem begins 
at point C and ends at point D. The distances from point A to point B and from point C to point 
D are black distances because they are interior to the letterform or outline of character 205 and 
are indicated by black arrows 211. The horizontal distance from left-side bearing point 210 to 
point A is a white distance because the distance is exterior to the letterform of character 205 
and is indicated by white arrow 212. Similarly, the horizontal distance 219 between point D 
and right-side bearing point 220 is a white distance. Distance 218 is also designated as a white 
distance, since it is a distance between stems 209 of character 205. The distance from point A 
to point C, shown by grey arrow 213, is a grey distance because the distance includes the black 
distance 211 from point A to point B and the white distance 218 from point B to point C. 
[0064] The black, white, and grey distances are relative to each other and can be illustrated as 
having a parent/child hierarchy in a directed acyclic graph (DAG) as illustrated in Figure 5b. 
Thus, point A is reckoned from left-side bearing point 210 and is also the child of left-side 
bearing point 210. In turn, point A is the parent of points B and C and points B and C are the 
children of point A. The inherent structure of widths and distances that are associated with a 
letterform allow for relevant typographical features to be identified at runtime, even if the 
distances and dimensions are not conveniently located in a control value table. 
[0065] Before describing the present invention further, a brief description of a glyph is 
presented. Figure 6 is a block diagram illustrating the outline and control points of a glyph. 
Outline 214 is defined by a series of control points 250, some of which may be on-curve and 
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some of which may be off-curve. If two successive control points are on-curve, they define a 
straight line. Control points are numbered consecutively, in this example, and if the curve is 
followed in the direction of increasing point numbers, the filled area will always be to the right 
of the control point. Key control points which define the black distance of the stem width are 
points 1 and points 22 in Figure 6. 

[0066] Figure 7 is a block diagram providing more detail to hinting module 106, previously 
discussed with reference to Figure 3. Hinting module 106 can be considered to perform 
hinting the image data such that a typographical feature (e.g., a stem) is adjusted to a position 
on a grid corresponding to a high contrast boundary between pixel sub-components. Figure 7 
illustrates examples of acts that correspond to hinting as is further explained below. 
[0067] Hinting module 106 receives image data after it has been scaled and then functions to 
grid fit the character to grid points defined by pixels and pixel sub-components. In step 260, 
hinting module 106 processes the hinting instructions that are provided by the typographer and 
moves certain key control points to the appropriate grid points such that the letterform is 
visually pleasing and legible. In act 260, some parts or control points of the character are 
moved and other parts and control points are left untouched. According to one embodiment of 
the invention, the act of grid fitting the image data as represented by act 260 is one example of 
a portion of hinting the image data. 

[0068] Phase control 270 involves moving the hinted points from act 260 onto pixel sub- 
component boundaries of high contrast. Frequently, the hinted points moved in phase control 
270 define the left edge of a character stem. According to the embodiment of the invention 
illustrated at Figure 7, the act of phase adjusting the typographical feature such that the 
typographical feature coincides with a location of the grid that represents a high contrast 
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boundary between pixel sub-components as represented by act 270 is one example of a portion 
of hinting the image data. 

[0069] Once the appropriate control points, such as those that define the left edge of the stems 
of a character, are positioned at high contrast boundaries between pixel sub-components, the 
other control points of the scaled image data are adjusted as needed. For example, the right 
edges of the stems can be repositioned on the grid such that the stems are given widths having 
values that may not be integer multiples of the width of entire pixels of the display device. In 
act 280, any points or segments of the outline that were not moved during act 260 and phase 
control 270 are now moved to new locations on the pixel grid using interpolation. Thus, in this 
embodiment, the act of interpolating remaining control points is one example of a portion of 
hinting the image data. 

[0070] Using the acts illustrated in Figure 7, the hinting process results in selected edges of the 
character being aligned with high contrast pixel sub-component boundaries, while allowing the 
character to have dimensions in the direction perpendicular to the striping of the display device 
having sub-pixel values or, in other words, values that are not necessarily integer multiples of 
the corresponding dimension of the full pixels. 

[0071] Figure 8 is a detailed block diagram of the phase control implemented by hinting 
module 106 of Figure 7 according to one embodiment of the invention, and further illustrates 
the acts that correspond to at least a portion of hinting the image data according to one 
embodiment of the invention. As mentioned previously, the invention can be practiced using 
any process that fully or partially analyzes the topology of the glyph at runtime. Figure 8 
relates to the use of a directed acyclic graph, such as that associated with Figure 5a and Figure 
5b. In step 271, the DAG of character 205 is derived from the interpretation of the hinting 
instructions which utilize the CVT and is illustrated in Figure 5b. 
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[0072] In step 272, phase control 270 looks for distinctive typographical features. For 
example, phase control 270 may attempt to locate the vertical stems of a character by searching 
for alternating patterns of black and white horizontal distances if the pixel grid has vertical 
striping. If the pixel grid has horizontal striping, phase control 270 may attempt to locate 
horizontal line segments in the character by searching for alternating patterns of black and 
white vertical distances. In general, step 272 searches for particular typographical features, 
including but not limited to stems or horizontal segments. This is accomplished at runtime 
because the distances and dimensions of the characters are available in the CVT table. 
[0073] For example, stems 209 of character 205 in Figure 5a are inferred by determining that 
the black distances represented by arrows 211 alternate with the white distances from left-side 
bearing point 210 to point A and from point B to point C. It is also possible to use the grey 
distance indicated by arrow 213 instead of the white distance from point B to point C to infer 
the presence of a vertical stem. 

[0074] In step 273, the DAG is traversed such that the stems may by phase adjusted or 
positioned on a high contrast pixel sub-component boundary. The first node of DAG 300 in 
Figure 5b that indicates a stem is point A. The stem is moved such that the left edge of the 
stem falls on a high contrast boundary, such as the boundary between the green and blue pixel 
sub-components. Thus, the green pixel sub-component is exterior to the letterform and the blue 
pixel sub-component is interior to the letterform. In a similar manner, the other stems of a 
character are also hinted to a high contrast boundary. 

[0075] One consideration that often arises when performing the hinting operations of the 
invention is adjusting for the potential error that the hinting process may introduce. As 
adjustments to the positions of the interdependent nodes are made as the DAG is traversed, the 
resulting placement of the right side bearing point of a character may become displaced. This 
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error may also have an effect on the overall width of the character being rendered. However, 
the contrast of the character is improved. Thus, improved contrast may result in characters 
having erroneous overall widths, which may include a displaced right side bearing point. 
[0076] The present invention may be embodied in other specific forms without departing from 
its spirit or essential characteristics. The described embodiments are to be considered in all 
respects only as illustrative and not restrictive. The scope of the invention is, therefore, 
indicated by the appended claims rather than by the foregoing description. All changes which 
come within the meaning and range of equivalency of the claims are to be embraced within 
their scope. 
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